Goto

Collaborating Authors

 essential element


FollowEval: A Multi-Dimensional Benchmark for Assessing the Instruction-Following Capability of Large Language Models

arXiv.org Artificial Intelligence

The effective assessment of the instruction-following ability of large language models (LLMs) is of paramount importance. A model that cannot adhere to human instructions might be not able to provide reliable and helpful responses. In pursuit of this goal, various benchmarks have been constructed to evaluate the instruction-following capacity of these models. However, these benchmarks are limited to a single language and are constructed using automated approaches, which restricts their applicability and the quality of the test examples they contain. To bridge this gap, we introduce the FollowEval benchmark in this paper. This benchmark is composed of instances in both English and Chinese, and all test examples are crafted by human experts. Furthermore, the FollowEval benchmark is designed to assess LLMs across five critical dimensions of instruction following: string manipulation, commonsense reasoning, logical reasoning, spatial reasoning, and response constraints. To enhance the complexity and present a sufficient challenge, each test example is designed to evaluate more than one dimension. We have evaluated various LLMs using the FollowEval benchmark and found that their performance significantly lags behind that of humans. This highlights the considerable room for improvement in the instruction-following ability of these models.


Pastor who used AI for church service says it was a 'one-time deal': 'Let's never do that again'

FOX News

Violet Crown City Church Pastor Jay Cooper said that using AI to conduct a service at his church did not capture the essential elements required for Christian worship. After using AI software ChatGPT to compose an entire service at his Methodist church, Pastor Jay Cooper says he will not be doing that again. The pastor of Violet Crown City Church in Austin, Texas told Fox News Digital this week he found himself uncomfortable with how AI presented Sacred Scripture during the service last month, claiming it was not "spirit empowered" and did not have the "human element" through which God communicates to his congregation. "It can get relative real quickly. But then, you know, some of it was just goofy. It would make these odd jokes, these kinds of metaphors or things they would try to tie in just did not make any sense," Pastor Cooper told the outlet about the AI-generated service he held September 17.


Modeling Small Oscillating Biological Networks in Analog VLSI

Neural Information Processing Systems

We have used analog VLSI technology to model a class of small os(cid:173) cillating biological neural circuits known as central pattern gener(cid:173) ators (CPG). These circuits generate rhythmic patterns of activity which drive locomotor behaviour in the animal. We have designed, fabricated, and tested a model neuron circuit which relies on many of the same mechanisms as a biological central pattern generator neuron, such as delays and internal feedback. We show that this neuron can be used to build several small circuits based on known biological CPG circuits, and that these circuits produce patterns of output which are very similar to the observed biological patterns. To date, researchers in applied neural networks have tended to focus on mam(cid:173) malian systems as the primary source of potentially useful biological information.


@Radiology_AI

#artificialintelligence

Once again, we see how radiology and chest imaging can benefit from image analysis methods that originated in other fields after they are translated by a capable group of experts who develop and test new tools that advance chest image analysis. In addition, we see the vocabulary of radiology expands to incorporate novel concepts from medical image analysis, such as isophotes, scale space, and invariants, that enrich our clinical literature. Author declared no funding for this work.


3 essential elements for mastering machine learning for 2020

#artificialintelligence

Thomas Edison famously said that success is 90% perspiration and 10% inspiration. Even though the hype around artificial intelligence has never been higher, the reality of what it takes to actually work in the field - and what it takes to use it successfully - is mired in confusion. Indeed, hype makes it look like 100% inspiration; it hides the work involved in building knowledge and learning skills. So, to help tackle that, here are the 3 important elements to machine learning that might structure how you'd approach it. This is the one thing that people overlook.


Internet of Medical Things Comes of Age

#artificialintelligence

What is the internet of medical things, or "IoMT" as it's sometimes called today? With the explosion of IoT use cases across industries, the medical space is no exception. Given the transformation of US healthcare to evidence-based outcomes with incentives that are beginning to align, metrics and patient feedback have become essential for care providers. Payers are increasingly interested in optimizing costs with treatments that are more effective than others. My personal experience with orthopedic sensors and the analytics possible with these sensors make me feel confident of a couple of things.


Book review: 'AIQ' explains machine learning fundamentals using human history

#artificialintelligence

What do Joe DiMaggio and birth control pills have to do with AI? And what does a lost submarine have to do with the future of robotics? AIQ is a book written by two statistics professors who attempt to use major moments in the history of war, sports, and data science to demonstrate how AI shapes the world today. AIQ uses plain English to explain mathematical concepts that underlie the major artificial intelligence trends today, including pattern recognition, prediction, and simultaneous localization and mapping (SLAM). The original hardcover was released in 2018, and the paperback is out today.


Natural Language Processing (NLP): An Essential Element of AI

#artificialintelligence

Artificial Intelligence is the research hotspot nowadays and is at the core of all types of automation that is going on in different fields. In this era of automation, working on manual repetitive tasks every day means a waste of efforts and precious resources, especially for enterprises and businesses where time and resources spent on a particular activity is a critical metric to assess the performance of the organization. WorkFusion Smart Process Automation (SPA) helps an enterprise to save both on time and money, while simultaneously increasing productivity and profits by eliminating manual intervention from about 90% of the total business tasks. Natural Language Processing (NLP) is an important part of artificial intelligence which is being researched upon to aid enterprises and businesses in the quick, speedy and fast retrieval of both structured and unstructured organizational data when needed. In simple terms, natural language processing (NLP), is the skill of a machine to understand and process human language within the context in which it is spoken.